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Abstract 

Fingerprint recognition plays an important role in many commer¬ 
cial applications and is used by millions of people every day, e.g. for 
unlocking mobile phones. Fingerprint image segmentation is typically 
the first processing step of most fingerprint algorithms and it divides 
an image into foreground, the region of interest, and background. Two 
types of error can occur during this step which both have a nega¬ 
tive impact on the recognition performance: ’true’ foreground can be 
labeled as background and features like minutiae can be lost, or con¬ 
versely ’true’ background can be misclassified as foreground and spu¬ 
rious features can be introduced. The contribution of this paper is 
threefold: firstly, we propose a novel factorized directional bandpass 
(FDB) segmentation method for texture extraction based on the di¬ 
rectional Hilbert transform of a Butterworth bandpass (DHBB) filter 
interwoven with soft-thresholding. Secondly, we provide a manually 
marked ground truth segmentation for 10560 images as an evaluation 
benchmark. Thirdly, we conduct a systematic performance comparison 
between the FDB method and four of the most often cited fingerprint 
segmentation algorithms showing that the FDB segmentation method 
clearly outperforms these four widely used methods. The benchmark 
and the implementation of the FDB method are made publicly avail¬ 
able. 
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1 Introduction 


Nowadays, fingerprint recognition is used by millions of people in their daily 
life for verifying a claimed identity in commercial applications ranging from 
check-in at work places or libraries, access control at amusement parks or 
zoos to unlocking notebooks, tablets or mobile phones. Most fingerprint 
recognition systems are based on minutiae as features for comparing fin¬ 
gerprints [I]. Typical processing steps prior to minutiae extraction are fin¬ 
gerprint segmentation, orientation field estimation and image enhancement. 
The segmentation step divides an image into foreground, the region of inter¬ 
est (ROI), and background. Two types of error can occur in this step and 
both have a negative impact on the recognition rate: ’true’ foreground can 
be labelled as background and features like minutiae can be lost, or ’true’ 
background can be misclassified as foreground and spurious features may be 
introduced. It is desirable to have a method that controls both errors. 

1.1 The Factorized Directional Bandpass Method, Bench¬ 
mark and Evaluation 

In order to balance both errors we take the viewpoint that - loosely speaking 
- fingerprint images are highly determined by patterns that have frequencies 
only in a specific band of the Fourier spectrum (prior knowledge). Focusing 
on these frequencies occuring in true fingerprint images (FOTIs), we aim at 
the following goals: 

1) Equally preserving all FOTIs while attenuating all non-FOTIs. 

2) Removing all image artifacts in the FOTI spectrum, not due to the 
true fingerprint pattern. 

3) Returning a (smooth) texture image containing only FOTI features 
from the true fingerprint pattern. 

4) Morphological methods returning the ROI. 

In order to meet these goals we have developed a factorized directional band¬ 
pass (FDB) segmentation method. 


The FDB method At the core of the FDB method is a classical Butter- 
worth bandpass filter which guarantees Goal 1. Notably Goal 1 cannot fully 
be met by Gaussian based filtering methods such as the Gabor filter. Obvi¬ 
ously, due to the Gaussian bell shaped curve, FOTIs would not be filtered 
alike. Because straightforward Fourier methods cannot cope with curva¬ 
ture (as could e.g. curved Gabor filters [2]) we perform separate filtering 
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into a few isolated orientations only, via directional Hilbert transformations. 
The composite directional Hilbert Butterworth bandpass filter (DHBB) in¬ 
corporates our prior knowledge about the range of possible values of ridge 
frequencies (between 1/3 and 1/25 pixels) or interridge distances (between 
3 and 25 pixels) [2], assuming a sensor resolution of 500 DPI and that adult 
fingerprints are processed. In the case of adolescent fingerprints [3] or sen¬ 
sors with a different resolution, the images can be resized to achieve an age 
and sensor independent size - not only for the first segmentation step, but 
also for all later processing stages. Our parameters can be tuned to reach an 
optimal tradeoff between treating all realistic frequencies alike and avoiding 
Gibbs effects. Moreover we use a data friendly rectangular spectral shape of 
the bandpass filter employed which preserves the rectangular shape of the 
spatial image. 

A second key ingredient is the factorization of the filter into two factors 
in the spectral domain, between which a thresholding operation is inserted. 
After preserving all FOTIs and removing all non-FOTIs in application of 
the first factor, all FOTI features not due to the true fingerprint pattern 
(which are usually less pronounced) are removed via a shrinkage operator: 
soft-thresholding. Note that albeit removing less pronounced FOTI features, 
thresholding introduces new unwanted high frequencies. These are removed, 
however, by application of the second factor, which also compensates for a 
possible phase shift due to the first factor, thus producing a smoothed image 
with pronounced FOTI features only. 

At this stage, non-prominent FOTI features have been removed, not only 
outside the ROI, but also some due to true fingerprint features inside the 
ROI. In the final step, these “lost” regions are restored via morphological 
operations (convex hull after binarization and two-scale opening and clos- 
ing). 

The careful combination of the above ingredients in our proposed FDB 
method yields segmentation results far superior to existing segmentation 
methods. 


Benchmark In order to verify this claim, because of the lack of a suitable 
benchmark in the literature, we provide a manually marked ground truth 
segmentation for all 12 databases of FVC2000 [1], FVC2002 [5] and FVC2004 
[6]. Each databases consists of 80 images for training and 800 images for 
testing. Overall this benchmark consists of 10560 marked segmentation 
images. This ground truth benchmark is made publicly available, so that 
other researchers can evaluate segmentation algorithms on it. 
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Evaluation against existing methods We conduct a systematic perfor¬ 
mance comparison of widely used segmentation algorithms on this bench¬ 
mark. In total, more than 100 methods for fingerprint segmentation can be 
found in literature. However, it remains unclear how these methods compare 
with each other in terms of segmentation performance and which methods 
can be considered as state-of-the-art. In order to remedy the current situa¬ 
tion we chose four of the most often cited fingerprint segmentation methods 
and compared their performance: a method based on mean and variance of 
gray level intensities and the coherence of gradients as features and a neural 
network as a classifier [7] , a method using Gabor filter bank responses [8] , a 
Harris corner response based method [9] and an approach using local Fourier 
analysis m- 


1.2 Related Work 

Early methods for fingerprint segmentation include Mehtre et al. mi who 
segment an image based on histograms of local ridge orientation and in m 
additionally the gray-level variance is considered. A method proposed by 
Bazen and Gerez [7] uses the local mean and variance of gray-level intensities 
and the coherence of gradients as features and a neural network as a classi¬ 
fier. Similarly Chen et al. use block based features including the mean 
and variance in combination with a linear classifier. Both methods perform 
morphology operations for postprocessing. A method by Shen et al. is based 
on Gabor filter bank responses of blocks m In 12 ], all pixels are regarded as 
foreground for which a valid ridge frequency based on curved regions can be 
estimated. Wu et al. [9] proposed a Harris corner response based method 
and they apply Gabor responses for postprocessing. Wang et al. m pro¬ 
posed to use Gaussian-Hermite moments for fingerprint segmentation. The 
method of Zhu et al. m uses a gradient based orientation estimation as 
the main feature, and a neural network detects wrongly estimated orienta¬ 
tion and classifies the corresponding blocks as background. Chikkerur et 
al. sni applied local Fourier analysis for fingerprint image enhancement. 
The method performs implicitly fingerprint segmentation, orientation field 
and ridge frequency estimation. Further approaches for fingerprint enhance¬ 
ment in the Fourier domain include Sherlock et al. uni, Sutthiwichaiporn 
and Areekul m and Bartunek et al. [IH1[I91[20]. 


1.3 Setup of Paper 


The paper is organized as follows: in the next section, we describe the pro¬ 
posed method beginning with the design of the DHBB filter for texture 
extraction in Section |2.1[ Subsequently, the extracted and denoised texture 


is utilized for estimating the segmentation as described in 2.2 which summa- 
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rizes the FDB segmentation procedure. In Section the manually marked 
ground truth benchmark is introduced and applied for evaluating the seg¬ 
mentation performance of four widely used algorithms and for comparing 
them to the proposed FDB segmentation method. The results are discussed 
in Section m 


2 Fingerprint Segmentation by FDB Methods 


Our segmentation method uses a filter transforming an input 2D image 
/(•) ^ ^ 2 ( 1 ^^) into defeature image 


fix) := 



di [m] 


( 1 ) 


Due to our filter design, the L 2 product above as well as all convolutions, 
integrals and sums are understood in the principal value sense 

[ f{yycpr{y-m)dy = (/(.), . 

Having clarified this, the symbol “pv” will be dropped in the following. At 
the core of Q is the DHBB filter conveyed by (/ counts directions, 
n and 7 are tuning parameters providing sharpness). In fact, we suitably 
factorize the filter conveyed by in the Fourier domain where 

{x) := with the argument reversion operator and apply 

a thresholding procedure T “in the middle”. Underlying this factorization 
is a factorization of the bandpass filter involved. The precise filter design 
will be detailed in the following. Note that the directional Hilbert transform 
is also conveyed by a non-symmetric kernel. Reversing this transform (as 
well as the factor of the Butterworth) restores symmetry. It is inspired by 
the steerable wavelet [211 Ea Ea] and to some extend similar in spirit to 
the curvelet transform [21], [25] and the curved Gabor filters [ 2 ]. We deal 
with curvature by analyzing single directions I separately before the final 
synthesis. 

Via factorization, possible phase shifts are compensated and unwanted 
frequencies introduced by the thresholding operator are eliminated, yielding 
a sparse smoothed feature image. This allows for easy binarization and 
segmentation via subsequent morphological methods, leading to the ROI. 

Note that 0 can be viewed as an analog to the projection operator in 
sampling theory with the analysis and synthesis steps (e.g. [26|). In this 
vein we have the following three steps: 
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L 


Error = 2.08% 


Figure 1: Overview over the segmentation by the FDB method: In the anal¬ 
ysis step, the original image (top row, left) is transformed into the Fourier 
domain (second column) and filtered by the first DHBB factor obtaining 16 
directional subbands (third and fourth columns). Next soft-thresholding is 
applied to remove spurious patterns (second row, third and fourth columns). 
In the synthesis step, the feature image (second column) is reconstructed 
from these subbands using the second DHBB factor. Finally, the feature 
image is binarized and the ROI is obtained by morphological operations. 
The estimated ROI (third row, left) is compared to manually marked ground 
truth segmentation (third row, right) in order to evaluate the segmentation 
performance. 
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Forward analysis (prediction): A first application of the argument 
reversed DHBB filter to a fingerprint image / corresponds to a number 
of directional selections in certain frequency bands of the fingerprint 
image giving ci[m\ above. 

Proximity operator (thresholding): In order to remove intermediate co¬ 
efficients due to spurious patterns (cf. [27]) we perform soft tresholding 
on the filtered grey values yielding di[m] above. 

Backward synthesis: Subsequently we apply the filter (non-reversed) 
again giving / assembled from all subbands. A numerical compari¬ 
son to other synthesis methods, summation (corresponding to a naive 
reconstruction) and maximal response in the appendix shows the 
superiority of this smoothing step. 

we work 



2.1 Filter Design for Fingerprint Segmentation 

The features of interest in a fingerprint image are repeated (curved) patterns 
which are concentrated in a particular range of frequencies after a Fourier 
transformation. In principle, the frequencies lower than these range’s limits 
correspond to homogeneous regions and those higher to small scale objects, 
i.e. noise, respectively. Taking this prior knowledge into account, we design 
an algorithm that captures these fingerprint patterns in different directional 
subbands in the frequency domain for extracting the texture. 

In this section, we design angularpass and bandpass filters. The angu- 
larpass filter builds on iterates of the directional Hilbert transformation, a 
multidimensional generalization of the Hilbert transform called the Riesz 
transform. It can be represented via principal value convolution kernels. 
The bandpass filter builds on the Butterworth transform which can be repre¬ 
sented directly via a convolution kernel. We follow here a standard technique 
designing a bandpass filter from a lowpass filter which has an equivalent rep¬ 
resentation in analog circuit design. 

2.1.1 The ^th Order Directional Hilbert Transform of a Butter- 
worth Bandpass 

Although a fingerprint image 


k = [kiM^ {-M,..., M] X {-iV,..., iV} ^ {0,..., 255} 
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Figure 2: Image (a) displays the angularpass filter with 9 — IStt/IG, 

n = 20. Images (b-c) show the ID and 2D Butterworth bandpass filters 
and with ujl — 0.3^ ojh = 1,7 = 2, (d) the spectrum of the 

DHBB filter Images (e-f) visualize the real and imaginary part of 

the DHBB filter Images (g-h) display the squared magnitude of 

the spectrum of the DHBB in the frequency and spatial domains which acts 
somewhat like a Gabor filter. 


is a discrete signal observed over a discrete grid, M, G N we start our 
considerations with a signal 


X — (xi, X 2 ) 1 -^ D := [—a, a] x [—6, b] [0,1] 


assuming values in a continuum a,b>0. The frequency coordinates in the 
spectral domain will be denoted by a; = ( 001 ^ 002 ) ^ 1^^- 

As usual, the following operators are defined first for functions / in the 
Schwartz Space of rapidly-decaying and infinitely differentiable test func¬ 
tions: 


= \ f eC 


00 /'Tn)d\ 


sup 


ii+\xr)4^fix) 

y I I f 


< -hoo , Vm, n G > , 


and continuously extended onto 


L2{R^) = \f E S{R^) 


L2 


= /J/( 


dx < +00 >. 




















In our context we only need d — 1,2. Further, we denote the Fourier and 
its inverse transformations by 

mi^) = f = fiu), = 77^ [ 

jRd ( 27 r) J^d 

where j denotes the imaginary unit with = — 1 . 


Butterworth bandpass For 7 G N and frequency bounds 0 < cjl < ojh^ 
setting A = ojh — fhe one-dimensional {d = 1) Butterworth 

bandpass transform is defined via 


B[f]{x) = 7 


-1 


bJ I —'Y 


(wA)27 


(a;A)27 + (u;2__p2)27 


/M 


(x) , 


:=b{u;) 


cf. [28]. It is easy to verify that b{uj) tends to zero for cj ^ 0 and cj ^ 00 and 
has unique maximum at the geometric mean p with value 1. In consequence, 
for high values of 7 , this filter approximates the ideal filter 


^ideal(^) 


1 if (jJl < (jJ < UJh 
0 else 


The ideal filter, however, suffers from the Gibbs effect. Letting t = 
we factorize the bandpass Butterworth as 


h\u) = 




n 


H«) 


H(-l) 


with tk = (A: = 1,..., 7 ), the negative squares of which repre¬ 

senting the 7 different complex roots of (—1). Then, with the below complex 
valued factor of 0 < m(w) = B{juj) ■ B{—juj) called the transfer function, 


H{t) = H 


\ jcoA ) 


n 


k=l 


_ A{juj) _ 

(jA)2 - A4(jA) -|-p2 


B{juj ), 


we use the approximation: joj = loge-’^ « obtain 

Rl ■ 1 ~ TT_ 2 A(e^-^^ — 1 ) __ 

[JOJ) ~ (4 + p2 _ 2 Atk)e ^7 + (2p2 _ 8 )e 7 + (4 + p2 + 2A4) ^ 

This approximation is often called the bilinear transform, which turns out 
to reduce the frequency bandwidth of interest, cf. Figure 
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The ID filter is then generalized to a 2D domain. The McClellan 

transform m. 130], ISH, 132], would be one favorable method. Also, re¬ 
cently, bandpass filtering with a radial filter in the Fourier domain has been 
proposed by [33], [3l] and [35] et al. for enhancing fingerprint images. How¬ 
ever, for a simpler reconstruction of 2D filter and a data-friendly alternative 
to the polar tiling of the frequency plane, a Cartesian array is used instead 

(see [23], |2S], |3S], [32]). 

Thus, on a rectangular domain D = [—a, a] x [—5, h] with common cuttoff 
frequencies 0 < and the two characteristic functions 

^ if 6|wi| > al^al , if 6|wi| < al^sl 

(see Figure]^, define 

'(p{uji,U2) = ST'(e-^‘^i)x/i(wi,n;2) + B'^ (2) 

as the spectrum of our two-dimensional Butterworth filter g^{x). Note that 
since ^(o;) G L 2 (M^), there is a well defined g^{x) = [^(u?)] (x). 

Figure (b) and|^ (c) show an example of the ID and 2D Butterworth 
bandpass filters. 


n-th order directional Hilbert transformations For more detail on 
the Hilbert transform T-L and the Riesz transform 7^, we refer the reader to 

the literature for an in-depth discussion m, 123], [33], m, @0], @111321133], 

@3], and @3]. 

Consider a vector u and set and compute, respectively, for x 




T 


-1 


W -j 



(3) 


nu[f]ix) 


{u,TZ[f]ix)) = 7 


-1 


II II /(<^) 


CJ 




(®) 


n—times 


T 


-1 


^ (-j)' 


llu^ll" 






n E 


K(<^) 
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The first line Q called the Riesz transform has a representation as a prin¬ 
cipal value integral 


^[/](®) = {f*pvh){x) = lirn / f{x-y)h{y)dy 


where 


h{y) := < 


/i. ||d-|-l d~\~ 1 

Try 


for d > 1 
for d = 1 


Setting hu{y) = {u, h{y)) and h^{y) = ... ^pvhu){y) we have for the 

third line Q called the n-order directional Hilbert transform that 


Since — 1 < ^ 1 ^ind high powers preserve the values near ±1 while 

forcing all other values in (— 1 , 1 ) towards 0 , this filter gives roughly the 
same result as an inverse Fourier transform of a convolution of the signal’s 
Fourier transform with 




1 if > cos a 

||u;|| — 

0 else 


for small cr > 0. The directional Hilbert transform, however, suffers less 
from a Gibbs effect than this sharp cutoff filter. 

In 2D, the direction vector is u = [cos(0), sin(0)]^ with the discretized 
6 ^ = ^ G [0, tt) and / = 0,1,..., L — 1, where L G N is the total number of 
orientation. Rewrite the impulse response of the n-th G N order directional 
Hilbert transform in Q as 


hl{ui,U2) 



hf{0Ji,0J2). (5) 


Putting together (Eq. (®, Q, @), for a fixed bandpass ojl < and L 
directional subbands we have thus the DHBB filter of order 7 , n: 


K[g'^]{x) = T 


-1 






(a.) := c(>r{x). (6) 


2.1.2 Thresholding 

For given /3 > 0, soft-thresholding is defined as follows 

X i-G T(x, /3) = • max (\x\ — O) . (7) 

\x\ 
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Thus, the thresholded coefficients are di[m\ = T{Q[m],/3}. Note that di[m\ 
is a solution of the -shrinkage minimization problem 

mm II u \\e^ II « - Cl \\% 

yielding soft-thresholding (cf. [IS]). Figure visualizes the effect of the 
soft-thresholding and the comparison with the others (such as: hard [16], 
semi-soft m and nonlinear |18] thresholding operators). 

2.2 Fingerprint Segmentation 

After having designed the FDB filter, let us now ponder on parameter se¬ 
lection, image binarization and morphological processing. 


2.2.1 Parameter Choice for Texture Extraction 

A fingerprint image will be rescaled such that its oscillation pattern stays 
in a specific range in the Fourier domain, the coordinates of which are 
uji = [—7r,7r],i G {1,2}. For choosing the cutoff frequencies ujl and ujh^ 
we incorporate our prior knowledge about adult fingerprint images at res¬ 
olution of 500 DPI: Valid interridge distances remain in a known range 
approximately from 3 to 25 pixels [2]. This corresponds exactly to uh = 1 
as a limit for high frequencies. A limit of = 0.3 for low frequencies of the 
Butterworth bandpass filter corresponds to an interridge distance of about 
12 pixels. The range \(jJi\ G contains the small scale objects which 

are considered as noise. The range \uji\ G [O^ojl] contains the low frequency 
objects, corresponding to homogeneous regions. 

The number of directions L in and the order n of the directional Hilbert 
transform involves a tradeoff between the following effects. We observe that 
with increased order n the filter’s shape becomes thinner in the Fourier 
domain. Although this sparsity smooths the texture image in the spatial 
domain, in order to fully cover all FOTIs, L needs to grow with n. However, 
a disadvantage of choosing large n and L is that errors occur on the boundary 
due to the over-smoothing effect as illustrated in Figure [^(o). 

The next parameter to select is the order of the Butterworth filter 7. 
An illustration of the filter for different orders 7 G {1,2,3,10} and with 
cutoff frequencies cjl = 0.3 and ojh = 1 is shown in Figure its bilinear 
approximation in Figure As 7 increases the filter becomes sharper. For 
very large values of 7, it approaches the ideal filter which is known to cause 
the unfavorable Gibbs effect. 

The thresholding value (3 separates large coefficients corresponding to 
the fingerprint pattern (FOTIs) (which are slightly attenuated due to soft- 
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thresholding) from small coefficients corresponding to non-FOTIS and FO- 
TIs which are not features due to the fingerprint pattern (these are elim¬ 
inated). On the one hand, if (3 is chosen too large, more prominent parts 
of true fingerprint tend to be removed. On the other hand, if /3 is chosen 
too small, not all all unwanted features (as above) are removed which may 
cause segmentation errors. 

In order to find good trade-offs, as described above, n, L, 7 and /3 are 
trained as described in Section [XT] In fact, since different fingerprint sen¬ 
sors have different properties, (3 is adaptively adjusted to the intensity of 
coefficients in all subbands as 

P = C • max{Q[m]}. ( 8 ) 

l,m 

Thus, instead of /3, C is trained for each sensor. 


2.2.2 Texture Binarization 


In the first step, the texture is decomposed by the operator 0 to obtain 
the reconstructed image f[k]. Then, f[k] is binarized using an adaptive 
threshold adjusted to the intensity of f[k]. Thus, the threshold is chosen as 

C • max(/[fc]), with C from ( 8 ). If /[fc] is larger than this threshold, it will 

k _ 

be set to 1 (foreground), otherwise, it is set to 0 (background) as illustrated 
in Figure 


1 , f[k] > C ■ max(/[fc]) 

/bin[fe] = { 

0 , else 


Vfc G 


2.2.3 Morphological Processing 

In this final phase, we apply mathematical morphology (see Chapter 13 in 
m), to decide for each pixel whether it belongs to the foreground or back¬ 
ground. Firstly, at each pixel /bin[^ 15 ^ 2 ] ^ {0,1}, we build an s x 5 block 
centered at (^ 1 ,^ 2 ) and 8 neighboring blocks (cf. Figure]^. Then, for each 
block, we count the white pixels and check whether their number exceeds 

2 

the threshold ^ with another parameter t > 0. If at least b blocks are above 
threshold, the pixel [ki^k 2 ] is considered as foreground. 
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^[ki-\-m^k2-\-rri\ — ^ ^ { <^5 O 7 ^ 

else 

(9) 


Then, the largest connected white pixel component is selected by a region 
filling method. Its convex hull is then the ROL For better visualization we 
have inverted white and black, i.e. display the background by white pixels 
and the ROI by black pixels, cf. Figure 

3 Evaluation Benchmark and Results 

The databases of FVC2000, 2002 and 2004 [ll|5l[6] are publicly available and 
established benchmarks for measuring the verification performance of algo¬ 
rithms for image enhancement and fingerprint matching. Each competition 
comprises four databases: three of which contain real fingerprints acquired 
by different sensors and a database of synthetically generated images (DB 

4 in each competition). 

It has recently been shown that real and synthetic fingerprints can be dis¬ 
criminated with very high accuracy using minutiae histograms (MHs) |50| . 
More specifically, by computing the MH for a minutiae template and then 
computing the earth mover’s distance (EMD) [5T] between the template MH 
and the mean MHs for a set of real and synthetic fingerprints. Classification 
is simply performed by choosing the class with the smaller EMD. 

The nine databases containing real fingerprints have been obtained by nine 
different sensors and have different properties. The fingerprint image quality 
ranges from good quality images (especially FVC2002 DBl and DB2) to low 
quality images which are more challenging to process (e.g. the databases of 
FVC2004). Some aspects of image quality concern both the segmentation 
step and the overall verification process, other aspects pose problems only for 
later stages of the fingerprint verification procedure, but have no influence 
on the segmentation accuracy. 

Aspects of fingerprint image quality which complicate the segmentation: 

• dryness or wetness of the finger 

• a ghost fingerprint on the sensor surface 


%-S,fc2-s] 

B\k,k2-s] 


B\h-sM 

[* 1 ,^ 2 ] 

• 

B[h,k2] 

Blki + sM] 

%-S,l2 + s| 

B[kl,k 2 +s] 



.dilate [^1 5 ^ 2 ] 


Figure 3: The 

morphological 

element. 
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• small scale noise 


• large scale structure noise 

• image artifacts e.g. caused by reconstructing a swipe sensor image 

• scars or creases interrupting the fingerprint pattern 

Aspects of fingerprint image quality which make an accurate verification 
more difficult, but do not have any influence on the fingerprint segmentation 
step: 

• distortion, nonlinear deformation of the finger 

• small overlap area between two imprints 

Each of the 12 databases contains 110 fingers with 8 impressions per finger. 
The training set consists of 10 fingers (80 images) and the test set contains 
100 fingers (800 images). In total there are 10560 fingerprint images giving 
10560 marked ground truth segmentations for training and testing. 

3.1 Experimental Results 

Segmentation Performance Evaluation Let Ni and N 2 be the width 
and height of image f[k] in pixels. Let Mf he number of pixels which 
are marked as foreground by human expert and estimated as background 
by an algorithm (missed/misclassified foreground). Let be number of 
pixels which are marked as background by human expert and estimated as 
foreground by an algorithm (missed/misclassified background). The average 
total error per image is defined as 


M/ + M5 


Ni X N2 


( 10 ) 


The average error over 80 training images is basis for the parameter selection. 
In Table we report the average error over all other 800 test images for 
each database and for each algorithms. 


Parameter Selection Experiments were carried out on all 12 databases 
and are reported in Table For each method listed in Table the required 
parameters were trained on each of the 12 training sets: the choice of the 
threshold values for the Gabor filter bank based approach by Shen et al 
[8], and the threshold values for the Harris corner response based method 
by Wu et al. [9]. The parameters of the method by Bazen and Gerez are 
chosen as described in [7]: the window size of the morphology operator 
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Parameters 

Description 

c 

a constant for selecting the threshold /3 in Eq. Q 

which removes small coefficients corresponding to noise. 

n 

the order of the directional Hilbert transform which 
corresponds to the angularpass filter in Eq. Q. 

L 

the number of orientations in the angularpass filter in Eq. (4). 

7 

the order of the Butterworth bandpass filter in Eq. (2). 

s 

the window size of the block in the postprocessing step in Eq. (9). 

t 

a constant for selecting the morphology threshold T in Eq. (9). 

b 

the number of the neighboring blocks in Eq. (9). 


Table 1: Overview over all parameters for the factorized directional bandpass 
(FDB) method for fingerprint segmentation. Values are reported in Table 


FVC 

DB 

C 

7 

t 

2000 

1 

0.06 

4 

5 


2 

0.07 

2 

5 


3 

0.06 

4 

4 


4 

0.03 

1 

5 

2002 

1 

0.04 

1 

4 


2 

0.05 

1 

7 


3 

0.09 

1 

5 


4 

0.03 

1 

6 

2004 

1 

0.04 

1 

7 


2 

0.08 

2 

5 


3 

0.07 

1 

6 


4 

0.05 

1 

5 


Table 2: Overview over the parameters learned on the training set. The 
other four parameters are n — 20, L = 16, s = 9 and 6 = 6 for all databases. 
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FVC 

DB 

GFB [H! 

HCR [S] 

MVC [7] 

STFT [in! 

FDB 

2000 

1 

13.26 

11.15 

10.01 

16.70 

5.51 


2 

10.27 

6.25 

12.31 

8.88 

3.55 


3 

10.63 

7.80 

7.45 

6.44 

2.86 


4 

5.17 

3.23 

9.74 

7.19 

2.31 

2002 

1 

5.07 

3.71 

4.59 

5.49 

2.39 


2 

7.76 

5.72 

4.32 

6.27 

2.91 


3 

9.60 

4.71 

5.29 

5.13 

3.35 


4 

7.67 

6.85 

6.12 

7.70 

4.49 

2004 

1 

5.00 

2.26 

2.22 

2.65 

1.40 


2 

11.18 

7.54 

8.06 

9.89 

4.90 


3 

8.37 

4.96 

3.42 

9.35 

3.14 


4 

5.96 

5.15 

4.58 

5.18 

2.79 

Avg. 


8.33 

5.78 

6.51 

7.57 

3.30 


Table 3: Error rates (average percentage of misclassified pixels averaged over 
800 test images per database) computed using the manually marked ground 
truth segmentation and the estimated segmentation by these methods: a 
Gabor filter bank (GFB) response based method by Shen et al [8], a Har¬ 
ris corner response (HCR) based approach by Wu et al. [9], a method by 
Bazen and Gerez using local gray-level mean, variance and gradient coher¬ 
ence (MVC) as features [7], a method applying short time Fourier transforms 
(STFT) by Chikkerur et al. [10] and the proposed method based on the fac¬ 
torized directional bandpass (FDB). 


and the weights of the perceptron which are trained in 10^ iterations due 
to the large number of pixels in the training database. For the method of 
Chikkerur et al.^ we used the energy image computed by the implementation 
of Chikkerur, performed Otsu thresholding and mathematical morphology 
as explained in m- 

For the proposed FDB method, the involved parameters are summarized 
in Table and the values of the learned parameters are reported in Table 
1^ Also, the mirror boundary condition with size 15 pixels is used in order 
to avoid boundary effects. In a reasonable amount of time, a number of 
conceivable parameter combinations were evaluated on the training set. The 
choice of these parameters balances the smoothing properties of the proposed 
filter attempting to avoid both under-smoothing and over-smoothing. 

This systematic comparison of fingerprint segmentation methods clearly 
shows that the factorized directional bandpass method (FDB) outperforms 
the other four widely used segmentation methods on all 12 databases. An 
overview of visualized segmentation results by the FDB method is given in 
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Figure A few challenging examples for which the FDB method produces 
a flawed segmentation are depicted in Figure Moreover, a comparison 
of all five segmentation methods and their main features for five example 
images are shown in Figure p!4| to 

4 Conclusions 

In this paper, we designed a filter specifically for fingerprints which is based 
on the directional Hilbert transform of Butterworth bandpass filters. A sys¬ 
tematic comparison with four widely used fingerprint segmentation showed 
that the proposed FDB method outperforms these methods on all 12 FVC 
databases using manually marked ground truth segmentation for the perfor¬ 
mance evaluation. The proposed FDB method for fingerprint segmentation 
can be combined with all methods for orientation field estimation like e.g. 
the line sensor method [52] or by a global model based on quadratic differ¬ 
entials [53] followed by liveness detection [5l] or fingerprint image enhance¬ 
ment [21ES]. It can also be used in combination with alternative approaches, 
e.g. as a preprocessing step for locally adaptive fingerprint enhancement in 
the Fourier domain as proposed by Bartunek et al [20] or before applying 
structure tensor derived symmetry features for enhancement and minutiae 
extraction proposed by Fronthaler et al. [56] . 

Notably, the filter is similar to the Gabor filter which could 

have been used instead of the DHBB filter. Similarly, Bessel or Chebbychev 
transforms as well as B-splines as generalizations dSU) could replace the 
Butterworth. We expect, however, for reasons elaborated, relying on the 
DHBB filter gives superior segmentation results. 

The manually marked ground truth benchmark and the implementation 
of the FDB method are available for download at 
WWW.stochastik.math.uni-goettingen.de/biometrics/, 

In doing so, we would like to facilitate the reproducibility of the presented 
results and promote the comparability of fingerprint segmentation methods. 
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Supplementary Appendix 


5 Comparison of the Operator in the FDB Method 
with the Summation and Maximum Operators 

We briefly illustrate the differences between the proposed FDB filter Q and 
the maximum and summation operators for the coefficients in all directional 
subbands. Figure [^compares the results of these operators for a low-quality 
and a good quality example. The functions are described as follows 


• The maximum operator without and with the shrinkage operator 0 
(depicted in the second and third row in Figure [Tol) 


{ max{Q[fc] • {ci[k] > 0)} +min{Q[fc] • {ci[k] < 0)} (without Q) 
max{(i/[fc] • {di[k] > 0)} + min {d/[fc] • (d/[fe] < 0)} (with 0) , 

with / = 0,1 ,..., L — 1. 

• The summation operator without and with the shrinkage operator 0 
(displayed in the fourth and fifth row in Figure [To|) 


/>] = 


L-l 


E<ilW 


1=0 


(without 0) 


(with 0) . 


6 Additional Figures 
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Figure 4: Four typical thresholding functions (red: hard, black: soft, green: 
semi-soft, magenta: nonlinear) are compared (top left). The following six 
pairs show an image and the visualization of the corresponding ID cross 
section along the red line. F.l.t.r and top to bottom: the original image 
/[fc], the coefficient ci[k] and the thresholded coefficients di[k] for the soft, 
hard, semisoft and nonlinear thresholding operators. Comparing the four 
cross sections in the bottom row, we observe that soft-thresholding achieves 
the sparsest solution. 
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(m) n=3 (n) n=20 (o) n=100 


Figure 5: Angular bandpass at 0 = ||,7 = 3 and different orders 

n G {3,20,100} and their responses (last row). 
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Figure 6: Butterworth bandpass filter at uol — = 1 and dif¬ 

ferent 7 , angular bandpass filter with n — 20, L = 16,0 = and their 
responses. row: ID Butterworth, 2^^^ row: 2D Butterworth, 3^^ row: 

row: 5^^ row: (0/’^ * 6^^ row: their re¬ 

sponses. 
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Figure 7: Image (a) displays a ID Butterworth bandpass filter (blue) and 
its approximation (red). Image (b) shows the 2D Butterworth bandpass 
filter ^(u?) at n = 20, 0 = 0 ,7 = 2, and the corresponding DHBB filter in 
the Fourier and spatial domains (c, d) for the approximation by the bilinear 
transform. Image (e) visualizes the 2D version of the original filter and the 
corresponding DHBB filter (f, g). 
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(a) (b) (c) (d) 


Figure 8: The ground truth segmentation (a) and the binarized texture 
image (b) for an example fingerprint. Applying a standard morphology op¬ 
eration like closing (dilation followed by erosion) instead of the proposed 
method connects in this example the white fingerprint texture with struc¬ 
ture noise close to the margin of the texture and the result is a defective 
segmentation (c). The proposed morphology avoids this undesired effect by 
considering neighborhoods on two scales: cells of size s x s pixels and blocks 
of 3 X 3 cells. 



(a) (b) 


Figure 9: The indicator functions in the horizontal direction (a) and vertical 
direction (b). 
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(a) Err = 1.98 (c) Err = 1.44 



(e) Err = 7.18 (g) Err = 5.1 



(i) Err = 5.15 (k) Err = 4.29 



(q) Err = 8.53 (s) Err = 2.82 


Figure 10: Comparison of five image reconstruction strategies and their 
effect on the resulting segmentation. columns: segmented images 

(error in percent) and reconstructed images for a low-quality image and 
3 rd 4 th columns for a good quality image. row: the proposed operator. 
2 nd 3 rd j-ows: maximum operator without and with the shrinkage operator 
Q, respectively. rows: summation operator without and with the 

shrinkage operator Q, respectively. 
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Figure 12: Segmented fingerprint images and the corresponding recon¬ 
structed texture images by the FDB method for FVC2000 (first and second 
row), FVC2002 (third and fourth row) and FVC2004 (fifth and sixth row). 
Columns f.l.t.r correspond to DBl to DB4. 


32 
















































Figure 13: Examples of incorrectly segmented fingerprint images due to: (a) 
a ghost fingerprint on the sensor surface, (b) dryness of the finger, (c) texture 
artifacts in the reconstructed image, (d) wetness of the finger. The first 
row shows the segmentation obtained by the FDB method, the second row 
displays the reconstructed image and the last row visualizes the manually 
marked ground truth segmentation. 
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(a) 



Figure 14: Segmented fingerprint images and their features of different meth¬ 
ods for FVC2002_DB3_IM_15_1. (a) ground truth; (b, g) FDB, (c, h) Gabor, 
(d, i) Harris, (e, j, k, 1) Mean-Variance-Coherence, (f, m) STFT. 
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(a) 




Figure 15: Segmented fingerprint images and their features of different meth¬ 
ods for FVC2004_DB1_IM_24_7. (a) ground truth; (b, g) FDB, (c, h) Gabor, 
(d, i) Harris, (e, j, k, 1) Mean-Variance-Coherence, (f, m) STFT. 
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Figure 16: Segmented fingerprint images and their features of different meth¬ 
ods for FVC2000_DB3_IM_17_3. (a) ground truth; (b, g) FDB, (c, h) Gabor, 
(d, i) Harris, (e, j, k, 1) Mean-Variance-Coherence, (f, m) STFT. 


36 



























(b) Err = 5.24 (c) Err = 13.83 (d) Err = 15.57 (e) Err = 6.74 



(j) (k) (1) (m) 


Figure 17: Segmented fingerprint images and their features of different meth¬ 
ods for FVC2004JDB2JM_56_8. (a) ground truth; (b, g) FDB, (c, h) Gabor, 
(d, i) Harris, (e, j, k, 1) Mean-Variance-Coherence, (f, m) STFT. 
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Figure 18: Segmented fingerprint images and their features of different meth¬ 
ods for FVC2004_DB2_IM_65_7. (a) ground truth; (b, g) FDB, (c, h) Gabor, 
(d, i) Harris, (e, j, k, 1) Mean-Variance-Coherence, (f, m) STFT. 
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